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ABSTRACT 


This  paper  is  an  atteo^t  to  describe  and  oharaeterisa  tha 
equiTalant  oonTex  program  of  a  tvo-staga  linear  program  undar 
uncertainty.  The  study  has  been  ditided  into  two  parts.  In  the 
first  oney  ve  examine  the  properties  of  tha  solution  sat  of  the 
problem  and  derire  explicit  expraasions  for  soma  particular 
cases.  The  second  section  is  deroted  to  tha  dariration  of  the 
obJeotiTe  function  of  tha  equiralant  conrax  program.  Ws  show 
that  it  is  convex  and  continuous.  Vfe  also  give  a  naeasaary 
condition  for  its  diffarentiabilily  and  establish  nacassaxy  and 
sufficient  conditions  for  the  solvability  of  tha  problem.  Finallyi 
va  give  the  equivalent  convex  inrogram  of  certain  classes  of 
programming  under  uncertainty  problems^  i.e.  whan  tha  constraints 
and  the  probability  space  have  particular  structures. 
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I.  INTRODUCTION 


The  standard  form  of  the  problem  — which  we  assume  solvable  — to 
be  considered  In  this  paper  ist 


(1) 


Minimise  s(x)  =  cx  t  E^Cqy} 
subject  to  Ax  =  b 


Tx  +  My  =  5,  C  on  (£,y,F) 
x^O,  y^O 

where  A  Is  a  matrix  m  X  n,  T  Is  m  x  n»  M  Is  m  x  n,  K  is  a 
random  vector  defined  on  the  probability  space  . 


This  problem  belongs  to  the  class  of  stochastic  linear  programming 
problems  for  which  one  seeks  a  here -and -now  solution.  Problem  (1)  is 
known  in  the  literature  as  the  two-stage  linear  program  under  uncertainty. 
One  interprets  it  as  follows:  The  decision  maker  must  select  the  activity 
levels  for  x,  say  x  =  x,  he  then  observes  the  ztodom  event  C  =  C 
and  he  is  finally  edlcwed  to  take  a  corrective  action  j,  such  that 

A  A 

y  >  0,  C  -  Tx  and  qy  is  minimum.  This  second  stage  decision  y 

is  taken  when  no  uncertainties  are  left  in  the  problem. 


It  is  clear  that  we  could  also  write  the  objective  function  of 
(1)  as: 

(1')  z(x)  =  cx  +  E^{Mln  qy|x) 


The  interpretation  given  above  indicates  that  (1)  as  well  as  (!')  are 
conventional  ways  to  express  the  same  concept.  Many  practical  problssui 


can  be  fomulated  to  fit  the  standard  form»  e.g.  Inyentoxy  problems^ 
planning  problems,  transportation  problems  with  uncertain  demand,  etc. 

All  quantities  considered  here  belong  to  the  reals,  denoted  9t  . 

mZI 

Vectors  will  belong  to  finite-dimensional  spaces  ll  and  whether  they 
are  to  be  regarded  as  row  vectors  or  column  vectors  will  always  be 
clear  from  the  context  in  which  they  appear.  Thus,  for  example,  the 
egressions 


=  (Xj^,X2,...,X^,...,X^) 

Tx  =  X 

yy  -^^yiyi 

are  easily  understood.  No  special  provisions  have  been  made  for 
transposirjg  vectors. 

For  the  sake  of  simplicity,  we  shall  assume  that  is  tlie 

probability  space  induced  in  Sf-,  F  determines  a  Lebesgue-Stieltjes 
measure  and  ^  is  the  completion  for  F  of  the  Borel  algebra  in  91*”^ . 

We  also  assume  that  C=E{C]  exists.  Also,  note  that  our  notation 
(  on  is  meant  to  imply  that  the  first  stage  decision  has  no 

effect  on  the  probability  space  on  which  K  is  defined.  In  other  words, 
K  is  Independent  of  x. 

The  marginal  probability  space  for  1=1,...,!  will  ba  denoted 
by  .  If  it  exists,  we  denote  the  density  function  of 
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by  *  dlierete  randoB  tkrlabl*^  ve  denote  ita 

probability  mass  function  also  by  •  No  confusion  should 

arise  from  this  abuse  of  notation.  Moreoter^  let  cr^  and  be 
respeetir  ly  the  greatest  Icsrer  bound  and  the  leaat  upper  bound  of 
^i*  ^i  bounded  belcv^  ve  set  or^  ^  if  3^  is  not 

bounded  aboTSi  ve  set 

We  usually  think  of  3  as  the  oontez  hull  of  all  elements  of  W 
vlth  positive  measure.  In  other  vords^  3  is  equal  to  the  intersection 
of  all  convex  subsets  of  vith  measure  one.  The  probabilily  measure 
may  be  discrete |  continuous,  or  a  mixture  of  both.  Only  in  one 
particular  case  (II. A),  shall  ve  use  another  charaoteriiation  of  3, 
namely  I  3  =  {C|f(0  i  O). 

The  first  part  of  this  paper  characterises  the  solution  set  of 
(1) ,  and  it  points  out  some  of  its  properties.  In  the  second  part,  ve  derive 
a  programming  problem  whose  set  of  optimal  aelutions  is  identical  to  the 
set  of  optimal  solutions  to  problem  (1)  • 
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II.  THE  SOLUTICN  SET 

We  are  0x117  intereated  In  the  here-and-nov  decision  to  be  taken. 

Thus,  a  solution  to  (1)  Is  not  a  pair  (x°,y°) .  To  see  this,  It 
suffices  to  remark  that  once  x  Is  selected  and  K  Is  obserred,  the  set 
of  optimal  second  stage  decisions  7,  Is  unlquel7  determined 
solving  the  linear  programs 

( 2)  Minimize  07 

subject  to  =  5  -  Tx 
7^0 

It  Is  tima  obvious  that  the  0x117  decision  variable  of  ;.Toblem  (1)  Is  x. 

Nevertheless,  the  second  stage  affects  our  decision  on  x  in  tvo 
ways.  First,  we  need  to  limit  our  set  of  acceptable  first  stage  decision 
to  those  for  which  there  exists  a  feasible  second  stage  decision,  l.e. 
problem  (2)  Is  feasible.  Also,  for  each  selection  of  a  vector  x,  we 
must  tfldce  Into  account  the  expected  costs  of  the  second  stage  decisions 
such  an  x  may  generate!  E^CMlnqylx}. 

A.  The  Set  of  Feasible  Solutions 

A  feasible  solution  to  (1)  is  a  vector  x  such  that  It  satisfies  the 
first  stage  constraints  and  such  that  It  is  always  possible  to  find  a 
feasible  solution  to  the  second  stage  problem  (2),  whatever  be  the  value 
assumed  hy  K  on  d,  Oantzlg  and  Madansky  [2]  call  such  a  solution  a 
permanently  feasible  solution.  The  word  ’'permanently”  was  Introduced  to 
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reinforce  this  notion  of  feasibility  of  the  second  stage  problen  for 
all  Talues  of  We  have  rejected  this  terminology  because  It  some¬ 
times  leads  to  confusion  in  the  understanding  of  problem  j . 

The  following  example  shows  how  the  Dantzig  -  Madansky  definition 
of  permanently  feasibility  differs  from  what  one  belieres  is  meant  by 
permanently  feasibility*  We  reserve  the  terms  "permanently  feasible" 
for  the  following  concept:  Select  a  vector  x  such  that  the  constraints 
be  satisfied  with  probability  one.  Consider  the  following  problem: 

(3)  Minimize  z(x)  =  cx  +  Q(Tx-C) 

xc  Q 

where  K  Is  a  m-dimensional  random  vector  on  {i£,^p?) ,  T  is  a  matrix 
m  X  n,  i.  =  {x|Ax  =  b,  x  ^  0)  and  Q  is  a  real -valued  function. 

If  Q  is  defined  as  followsi 

Q(Tx-0  =0  if  Tx  ^  C 

Q(Tx-5)  = +•  otherwise 

then,  for  each  given  K,  (3)  is  a  linear  programming  problem.  Such  a 
function  Q(Tx-^)  requires  permanent  feasibility,  l.e.  if  there  exists 
a  solution  (2(x)  /  +®)  to  problem  (3)  it  sust  satiety  the  condition: 

(4)  Tx^5  V5sH 

To  see  that  problem  (1)  is  not  as  restrictive,  e.g.  let 

Qdx-O  =E,j  Jq,(T.x-0 

ll«l 


where 
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Ql(T^x-Ci)  =  0  If  ^ 

Q^(T^x-Ci)  =  -T^x)  if  T^x  ^ 

Such  a  function  Q(Tx-5)  does' no  longer  inpose  permanently 
feasibility,  i.e.  i(x)  is  no  longer  identically  equal  to  +  ®  for 
all  X  which  does  not  satisfy  condition  (4)  •  We  can  then  rewrite 
(3)  as  follows  I 

(5)  Minimize  z(x)  =  cx  E^{0.y'*^  +  q"y”J 

subject  to  Ax  =  b, 

Tx  +  ly"*^  -  Iy~  =  C,  K  on  (a,fiF,F) 

X  2  0,  ^  0,  y"  ^  0 

Problem  (5)  Isa  special  case  of  problem  (1) ,  known  as  the  coaiplete 
problem  [5]. 

From  our  definition  of  feasible  solution,  it  is  clear  that  the 
decision  maker  is  limited  in  its  decision  by  a  double  set  of  constraints. 
Let 

=  {x|Ax  =  b,  X  2  O)  . 

V/e  say  that  Is  the  set  determined  by  the  fixed  constraints. 

(6)  Proposition!  is  a  conrex  polyhedron 

A  set  C  is  convex  if  x^,  X2f  C  implies  [x^jXg]  C.  By 
convex  polyhedron  we  mean  that  can  be  written  as  the  sum  of  a 

convex  polytope  (convex  hull  of  a  finite  number  of  points  in  and 
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a  convex  poljhedral  cone. 
Let 


¥^2  -  3y^0  such  that  =  5  -  TxJ 


We  say  that  Is  the  set  representing  the  constraints  Imposed  on 
our  vector  x  by  the  Induced  constraints.  The  word  "induced”  means 
that  these  constraints  are  the  restrictions  imposed  on  x  by  the 
condition:  The  second  stage  problem  (2)  must  be  feasible  for  all 
.  This  is  the  real  meaning  of  the  equality  sign  found  in  the 
constraints  of  the  standard  form: 


Let 


Tx  +  My  =  ?  ,  K  on 


~  ”  5  for  some  y  ^  O) 

It  is  easy  to  see  that  is  a  convex  polyhedron, 

(7)  Proposition:  K2  is  convex 

We  hpve  =  fl  >  "then  K«  is  either  empty,  a  singleton  or 

^  U  d  ^ 

for  all  pairs  of  points  x^jX^eK^  we  have  x^jX^eKg^  for  all 

Then  \K  t  d,  also  [x^,X2]  c;  PI  K25  =  K2. 

(as 

Obviously, 

(8)  Proposition:  K  =  (1  K2  is  a  convex  set 

where  K  is  the  set  of  feasible  solutions.  Remark  that  we  have  e^^ressed 


the  set  of  feasible  solution  in  terms  of  x  along,  rather  than  x  and  y 
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In  what  follovsi  we  assuioe  that  K  has  full  dimension.  If  this  were 
not  the  case,  one  vfould  need  to  appeal  to  the  relative  topology.  Most 
of  our  proofs  do  not  require  this  assumption,  but  it  simplifies  our 
treatment  cmd  terminology. 

The  set  is  immediately  available  in  terms  of  linear  equations 
and  inequalities  involving  x  only.  The  set  presents  much  more 
difficulty.  In  general,  say  when  i  is  a  continuvim,  l.e.  PI  is 

an  infinite  intersection  of  convex  polyhedrons,  then  the  characterization 
of  K2  in  terms  of  x  along  is  a  much  more  complex  problem.  One  main 
difficulty  one  encounters  in  trying  to  solve  a  program  under  imcertalnty 
(no  assumptions  on  the  probability  space  or  on  the  structure  of  the 
constraints  of  (1))  lies  in  determining  whether  or  not  a  given  x  belongs 
to  K. 

We  now  examine  some  special  case  where  the  assumptions  made  either 
on  the  constraints  structure  of  problem  (2)  or  on  the  probability  space 
(d,^F)  allow  us  to  obtain  fairly  easily  an  explicit  expression  for  the 
set  K2  (and  so  for  K)  . 

1.  E  has  a  finite  number  of  points  (Card  [-I  <  «) 

The  Intersection  fl  is  finite  and  since  is  a  convex 

5  12  k 

polyhedron,  so  is  and  so  is  K.  Let  ?  ,C  be  the  values 

of  K  for  which  f(5)  ^  0.  Then, 


K2  =  {x|Tx  +  My*^  =  X  =  l,...,k) 
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2.  The  matrix  M=I  (Idantlty)  and  H  la  compact 

Then 

K2  =  Ul  V^«=i  3y  ^0  and  y  =  C-Tx) 

which  Implies 

X€K2  iff  V5i=>«^-Tx^0 

Since  d  Is  boiindedi  3  a  smallest  closed  Interrali  say 
H*  c  91®  ,  with  lowar  bound  cr>  such  that  H  c5».  The  o^’s 
correspond  to  the  lover  bounds  for  the  random  Yarlables  l^l^.t.^m. 

(9)  Propositi  on  t  V^«S»  ^-Tx^O  iff  Tx  ^  a 

The  proof  of  this  proposition  is  trirlal.  We  hare, 

(10)  K2=(x|Tx^a) 

3.  M  =  Cl,-l) .  The  problem  Is  complete 

One  says  that  problem  (1)  Is  complete  [  5]  when  the  matrix  M 
(after  an  appropriate  rearrangement  of  rows  and  columns)  can  be 
parti oned  In  two  parts,  whose  first  part  is  the  Identity  matrix  and  the 
second  part  is  the  negative  of  an  identity  matrix,  M=(I,-I).  This 
case  seems  to  represent  a  very  importcoit  class  of  applications  of 
programming  under  uncertainty.  It  Is  thus  an  encouraging  fact  that  the 
set  K  can  be  expressed  Immediately  In  terms  of  linear  constraints  in 
X.  No  assus^tion  at  all  is  necessary  on  the  probability  space  • 
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Let  us  partition  the  vector  y  as  follows 

y  =  (y^  »y') 

where  y"*^  corresponds  to  I  and  y  to  -I,  then 

=  {xlv  Sy"*^  >0,  y"  ^  0  such  that  -y"  =  f;  -  Tx) 

(11)  Proposition:  K  = 

Since  (it  is  always  possible  to  express  any  number 

as  the  difference  of  two  non-n^atlve  numbers),  we  have  K=K^n5R^=K^. 

This  property,  K=K^,  gives  an  intuitive  justification  for  the 
use  of  the  word  ’’complete”.  Nevertheless,  we  should  remark  that  K=K^ 
does  not  imply  that  M  =  (1,-1). 

B.  A  Feasibility  Test 

We  now  fix  x  and  K  and  concentrate  our  attention  on  the 
feasibility  of  problem  (2).  From  Farkas'  lemma  we  get; 

(12)  Either  the  equations 

Viy  =  K-Tx 

have  a  non-negative  solution  or  the  inequalities 
uM  >0  u(^  -Tx)  <  0 

have  a  solution. 

(13)  Proposltoni  xeK^  iri*  we  have  U(x,  0  >  0,  where 


U(x,0  =  (Min  u(^  -  Tx)  |uM  >  O) 
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If  for  a  given  x  and  we  have  U(x,0  ^  0,  it  implies 

that  the  system  of  inequalities  uM  ^  0  and  n{l.  -Tx)  <  0  have  no 
solution.  By  (12),  the  system  My=^-Tx  has  then  a  non-negative 
solution,  for  all  This  means  that  ^*^2* 

Proposition  (13)  yields  a  test  which  allows  us  to  determine  if  a 
given  xeK^,  is  or  is  not  a  feasible  solution  to  (1).  nonetheless, 
such  a  procedure  would  be  completely  inefficient  if  we  had  to  perform 
this  test  for  all  1.  in  If  H  does  not  have  finite  cardinality, 

+hls  test  for  any  given  x  would  involve  solving  an  infinite  number  of 
linear  programs  of  the  form: 

Minimize  u(^-Tx) 

subject  to  uM  ^  0 

If  problem  (1)  is  stated  in  a  slightly  different  form  (it  is  very 
often  possible  to  reduce  problem  (1)  to  (14)) »  viz.: 

(14)  Minimize  z(x)  =  cx  +  E^{qy} 

subject  to  Ax  =  b 

Tx  +  on  (:i,^,F) 

X  >  0,  y  ^  0 

it  is  possible  to  obtain  a  more  efficient  test.  We  then  apply  the 
following  form  of  Parkas'  lemma:  Exactly  one  of  the  two  alternations 
holi:  Either  the  inequality 


^  t  -  Tx 
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has  a  non-negative  solution,  or  the  Inequalities 

uM  ^  0  u(^  -Tx)  <  0 

have  a  non -negative  solution. 

Then 

(15)  Propositi  on  t  xeK  iff  x*K^  and  «£,  U(x,0  >  0,  where 

U(x,0  =  {Min  u(i:  -Tx)  |uM  ^  0,  u  ^  O) 

If  d  has  a  lower  bound — from  a  practical  point  of  view  this  is 
a  very  mild  condition — then,  let  or  be  such  that  atd.  and  or^  ^ 
for  all  1=1,... ,m.  Since  u  is  restricted  to  be  non-negative, 

we  have 

U(x,a)  ^U(x,0 

Moreover,  ores  and  U(x,o)  <  0  imply  that  there  exists 
at  least  one  point  of  d  for  which  the  condition  U(x,0  ^  0  does  not 
hold.  By  Proposition  (10)  this  x  is  not  a  feasible  solution.  We  have 
proved: 

(16)  Proposition:  xcK  iff  xeK^  and  U(x,a)  ^  0 

For  this  case,  it  is  thus  sufficient  to  solve  one  linear  program 
to  test  the  feasibility  of  a  given  x  which  belongs  to  K^.  Proposition 
(11)  is  not  true  if  ^  for  all  i  =  l,...,m  but  a  :z. 

For  instance,  consider  the  following  exEunplei 


Let 
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T  = 

m 

1 

0“ 

M  = 

"1  -1‘ 

1 

1  1 

=  =  {^1-1  ^2  ^  ^2  ^ 

and  let  X  =  (£^,^3)  =  (0|0)  belong  to  K^»  By  definition  of  Ep 
a  =  =  (-1>0)  .  It  Is  easy  to  see  that  E  c  {C|C  =  ^^,  7^0) 

and  that  the  affine  transformation  obtained  by  translating  E  by  Tx, 
map  :i  into  Itself  (Tx  =  O) ,  i.e.  x  =  0  «K  .  But  U(x,a)  is  not 
bounded  below. 

Suppose  now  that  we  have  at  hand  x  such  that  xeK^  and 
U(x,a)  <  0,  where  U(x,cr)  is  as  defined  in  (15).  Let  u  be  an 
optimal  solution  toi 

Minimize  u(cir  -  Tx) 
subject  to  uM  ^  0 
u  ^  0 

Since  U(x,cr)  <  0,  we  have  ua  <  uTx  and  by  (I6)  x  /  K.  Thus,  every 
X  c  K  must  satisfy  the  Inequalityi 

(17)  (uT)  X  ^  ua  . 

Wc  can  add  this  condition  (12)  to  the  fixed  constraints,  Ax  =  b,  x  ^  0. 
It  has  the  effect  of  cutting  off  part  of  the  set  K^. 
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III.  THE  EQUIVALBIT  CONVEX  FROQIUMMING  PROBLIM 

We  now  show  that  a  linear  program  \mder  uncertainty  can  be 
e3q)re88ed  in  term8  of  flr8t  8tage  deei8ion  variable  x,  a8  a  conrex 
program  that  ve  8hall  call  the  equivalent  eonyex  programmipg  problwn. 

We  derive  the  propertlee  of  the  objective  function  of  the  equivalent 
convex  program  and  construct  the  equivalent  convex  program  when  the 
constraints  and  the  probability  space  satisfy  the  assunqptions  made  in 
Section  II. 

A.  The  Equivalent  Convex  Program 

(18)  Definitiont  A  programming  problemt  Minimize  f(x)f  xeK,  is 

an  equivalent  programming  problem  to  (1),  if  f(x)  is  giren  explicitly 
for  each  x  (not  Just  as  a  function  of  x,  y,  and  K  as  in  (1’)))  if 
K  is  the  set  of  feasible  solutions  to  (1) ,  and  if  an  optimal  solution 
to  the  equivalent  programming  problem  is  an  optimal  solution  to  (1) . 

In  Section  II ,  ve  have  already  characterized  the  set  of  feasible 
solutions  to  (1) .  To  exhibit  an  equivalent  convex  program  to  (1) ,  it 
suffices  to  show  that  (1')  is  convex  in  x.  Let  us  consider  the  second 
stage  problem  (2)  for  a  fixed  1.  in  as  a  function  of  x.  Then, 
by  Proposition  (3)  of  Appendix  I, 

(19)  P(x,0  =  {Min  qy|ltr  =  K-Tx,  y  ^  O) 

is  a  convex  of  x  on  [x|Tx  =  K  -Ityp  7^0}  and  in  particular  on  K^. 
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By  the  duality  theorem  for  linear  programs »  vt  haTe 


(20)  P(x,0  =  Q(x,0 
where 

Q(*»0  =  (Max  n( C  - Tx)  |ttM  ^  q)  for  fixed  ^  in  3. 

Let 

(21)  QCx)  =  E^{Mln  qy  |Hir  =  t  -Tx,  y  ^  O)  =  E^[Q(x,0  }  =  E^(P(x,0  ) 
be  the  expected  value  of  the  second  stage  problem  (2)  for  a  given  x  in 

Kj. 

(22)  Proposition!  Q(x)  is  convex  on  Kg  [2]. 

Since  by  Proposition  (3)  of  Appendix  1,  Q(x9  0  ie  convex  in  x 
on  Kgi  it  suffices  to  remark  that  applying  the  operator  to  Q(Xf^) 
is  equivalent  to  performing  a  positive  weighted  linear  combination  of 
convex  functional  i.e.  C.(x)  is  convex  on  Kg* 

Thus  the  equivalent  convex  program  to  (1)  iS| 


(23) 


Minimize  z(x)  =  cx  t  Q(x) 
subject  to  x«K 


(24)  Proposition!  Q(x)  is  continuous  on  Kg. 

Since  Q(x)  is  convex  on  Kgi  the  result  is  immediate  if  Kg  is 
open.  To  see  that  Kg  could  be  open,  consider  the  following  example t 
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Let  M  =  l,  T  =  1  and  s=(0,l),  then  K2=(“*»  O).  In  general,  by 
Corollary  (12)  of  Appendix  I,  Q(x, is  uniformly  continuous  in 
X  and  thus  Q(x)  =  f  Q(x,0dF(0  is  continuous  in  x  on  Kp. 

Acs 

Consider  the  dual  to  the  second  stage  problem  (2), 


(25)  Maximize  n(j;-Tx) 

subject  to  nM  ^  q, 

and  let  tt(x,  0  be  the  optimal  solution  to  (25)  for  fixed  x  and 
In  what  follows,  we  assume  that  n(x,0»  and  Q(x,^)  are  defined  for 
all  X  in  K,  and  all  I,  in  s.  Define 


(26) 


n(x)  =  E^{tt(x,0)  =  f  T7(x,0dF(0 


as  the  expected  optimal  solution  to  problem  (25)  for  a  given  x.  Also, 
let 


t(x)  =  E^{n(x,^)5]=  /*  n(x,0^,dF(0 


jte  that  n(x)  is  a  ra-dimenslonal  vector  and  that  i|r(x)  is  a  scalar. 


(27)  Proposition;  [c  -n(x)T]x  =  -i^(x)  is  a  supporting  hyperplane 
of  z(x)  at  x  =  x,  where  xc  K  [2], 

Since  [c  -n(x)T]x  4  i|r(5c)  =  z(x),  it  suffices  to  show  that,  VxeK, 
z(x)  >  [c  -tt(x)T]x  4  ^(x)  .  But  this  is  true,  since  for  all  xeK,  and 
for  all  I,  in  s,  n(x,0(^-Tx)  >  n( x, 0  ( ^  -  Tx)  .  Integrating  both 
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sides  with  respect  to  dF(  0  adding  cx  on  both  sides,  we  geti 

z(x)  =  [c -n(x)T]x+ t(x)  ^[c-n(x)T]x+  i)[(x). 

(28)  Corollary!  [G-n(x)T]  is  a  gradient  of  z(x)  at  x. 

We  use  the  term  "gradient”,  as  defined  in  (  7)  of  Appendix  II. 

(29)  Proposition!  If  F(0  Is  continuous,  then  z(x)  is  differentiable 

.n  K. 

By  F*roposition  (15)  of  Appendix  I,  n(x,0  is  piece-wise  constant. 
Moreover,  since  the  set  of  points  where  n(x,  ^)  is  nuQ.ti -valued  has 
measured  zero,  n(x)  and  i|i(x)  are  unique  for  all  xtK.  This  In^lles 
that  z(x)  has  z  unique  supporting  hyperplane  for  all  x  in  K.  By 
Proposition  (11)  of  Appendix  II,  z(x)  is  differentiable  on  K. 

The  condition  F(0  continuous,  is  sufficient  but  not  necessary, 

^^.g.,  let 

T-M=I,  =={C^=(2).  <;^=(i)3.  f  ( th  =  f  ( ?*)  =  1/2 
c  —  [2,2],  q  —  [1,1],  X  —  [x^,X2] 
then  z(x)  =  x^  +  x^. 

(30)  Proposition!  Let  x°cK,  then  x^  is  optimal  iff  3n(x°) 
such  that  VxfK,  [c  - n( x°) T]x°  ^  [c  -n(x°)T]x. 

The  proof  is  a  direct  application  of  (28)  and  Proposition  (l^  of 


Appendix  II. 
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(31)  Corollary;  If  z(x)  is  differentiable,  then  x°  is  optimal 
iff  for  all  X  in  K,  fc -n(x°)  T]x°  ^  [c -nCx*^)  T]x. 

One  could  regard  (30)  and  (31)  as  statements  related  to  the 
solvability  of  problem  (1) .  If  we  disregard  the  inconsistent  case 
(K  is  empty),  we  can  write;  (l)  is  solvable  iff  3  a  pair  (x°,n(x°)) 
such  that  [c -n(x°)T]x°  <  [c -n(x°)T]x,  for  all  x  in  K.  Note  that 
(1)  can  have  an  infinite  or  a  finite  infimum.  Moreover,  since  z(x) 
is  continuous,  z(x)  may  fail  to  achieve  a  minimum  on  K  only  if  K  is 
not  bounded. 

3 .  Special  Cases 

When  the  constraints  of  problem  (l)  and  the  probability  space 
satisfy  the  assumptions  considered  in  Section  I,  we  show  that  the 
equivalent  convex  programs  are  programming  problems  for  which  satisfactory 
algorithms  exist. 

1.  3  is  finite 

Let  be  the  values  assumed  by  the  random  vector  ^ 

with  probabilities  f^,f^, . . . ,f^,  respectively.  We  have  seen  in 
Section  I  that  the  induced  constraints  can  be  expressed  explicitly  in 
terms  of  linear  equations  and  linear  inequalities.  The  equivalent  convex 
program  is  a  linear  programming  problem  which  can  be  expressed  as 


follows; 
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(32) 


Minimize 


z(x)  =  cx  +  r  qj' 


f^ay^  + 


»2  2  , 
f  qy  4, 


^ -k  k 
.4f  qy 


subject  to 


Ax 
Tx  4- 
Tx  4- 

Tx  4- 

*  ^  ^  o»  y' 


=  b 


^  0,..  .,y^  >  0. 


Dantzig  and  Madansky  [  2]  hare  shown  that  there  exist  a  dual  of 
this  problem  which  is  in  the  standard  form  for  the  application  of  the 
decomposition  algorithm  of  Dantzig  and  Wolfe  [4]*  To  find  this  dual 
problem,  we  use  a  more  direct  approach  than  the  one  found  in  [  2  ] . 

-1  -2  -k 

Let  (o,TT  ,n  )  be  the  Tariable  appearing  in  the  usual  dual 

formulation  of  (32) .  Define 

fA 

then  the  dual  reads  1 

Maximize  ob  4  .  .4 

oA  4  f^Ti^T  4  fSr^  4... 4  f^n^T  ^  c 

TT^  ^  ^ 

TT^  ^  q 

'  ■  n'Sd  ^  ^ 
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This  problem  has  an  "angular”  structure.  The  first  n  Inequalities 
can  be  used  to  generate  the  master  program.  The  last  k  X  n 
Inequalities  constitute  the  sub-problem.  Depending  on  T  and  M, 
it  may  be  advantageous  to  use  variants  of  the  decomposition  algorithm, 
e.g.,  see  Abadle  [l] . 


Another  simple  t  •ansformation  gives  the  problem  (32)  the  structure 
of  a  multi-stage  system  (so  called  "staircase"  system)  where  the  linear 
constraints  for  all  stages  but  one  are  identical.  This  last  feature 
may  simplify  considerably  the  computation.  To  obtain  this  form, 

ir+1  X+1 

subtract  from  each  row  of  Tx  +  My  -  K  the  corresponding  row  of 
Tx  1  I'iy  =  K  for  X  =  l,...,k-1.  Problem  (32)  becomesi 

Minimize  z(x)  =  cx  -»  f^qy^  +  f^qy^  +...+  f^  ^qy^  ^  f^qy^ 


subject  to 


Ax 

=  b 

Tx  + 

My^ 

II 

M 

1  2 

r2  A 

— 

+  ^^y 

• 

• 

.  w  k-1  k  -k  ,k-l 

-My  +  My  =  ^  -f; 

X 

IV 

0,  >  0,  y^  >  0,  • 

k-1  .  ^  k  .  „ 

•  •  y  >  y  >  0  • 

2.  M  is  square,  non-singuleir  and  d  is  bounded 

We  show  that  under  these  assumptions  there  exists  a  linear  p.'ogramming 
problem  whose  set  of  optimal  solutions  is  the  set  of  optimal  solutions  of 
th*<  linear  progreim  under  uncertainty. 


The  problem  under  consideration  is: 


Minimize  z(x)  =  cx  +  E^[qy) 
subject  to  Ax  =  b 

Tx  +  ly  =  K,  K  on  (s,^,F) 

X  ^  0,  y  ^  0 

For  fixed  x  and  K,  the  second  stage  problem  (2)  is: 

(33)  Minimize  qy 

subject  to  ly  =  ?  -  Tx 
y  >  0 

If  (33)  is  feasible,  then  Min  qy  =  q(^  -Tx).  Moreover,  if  xtK, 
then  (33)  is  feasible  for  all  K  in  £,  i.e.  ?  -Tx  >  0  for  all  ^ 
in  We  have 

E^{Min  qy|xeK}  =  E^{q(^  -  Tx)  }  =  q?  -  qTx 
3y  (9)  and  (lO)  there  exists  a  vector  or  such  that 
K  =  {x|Ax  =  b,  Tx  <  Of,  X  >  0} 

Thus,  the  llnesir  program 


Minimize  z(x)  =  (c  -qT)x 
subject  to  Ax  =  b 
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yields  the  set  of  optimal  solutions  to  o\ir  problem.  If  s  is 
compact,  then  each  neighborhood  of  has  positive  measure.  If 

the  random  variables  i=l,...,m,  are  independent,  then  :i  is 

an  interval  (in  91®)  and  H*  =  £  (9)  . 

b)  M  is  square  and  non-singular 

The  problem  reads: 

Minimize  z(x)  =  cx  +  E^{qy} 
subject  to  Ax  =  b, 

Tx  +  My  =  ?,  K  on  (H,^,F) 

X  ^  0,  y  >  0  . 

If  one  multiplies  to  the  left,  both  sides  of  Tx  +  I-ty  =  ^  by 
M~^  =  obtains: 

Tx  +  ly  =  ^»  K  on  (s,^,F) 

where 


T  =  M"^T 


Since  £  is  bo\inded  by  assumption  and  M  ^  is  a  non-singular 
linear  mapping,  =  is  also  boimded.  Hence,  our  new  problem  is  similar 
to  the  previous  case  (M  =  l).  Let  s*  be  the  smallest  interval 
containing  £  and  let  oi*  be  the  lower  bound  of  — The  equivalent 


convex  program  then  reads: 
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Minimize  z(x)  =  (c  -qM  ^T)x 

subject  to  Ax  =  b 

M"^Tx  <  or* 

X  >  0 

The  components  of  the  vector  or*  can  be  computed  as  follows: 

Let  and  3^  be  respectively  the  greatest  lower  bound  and  the 

least  upper  bound  for  then 

m 

3=1 

m 

'  '3  "  “3  “  '*13  ^  ° 

3=1  . 

^j  ^  ^j  ‘‘ij  ° 

From  this  computation  procedure  for  a*,  it  is  easy  to  see  that  the 
condition,  d  bounded,  is  too  strong;  all  we  need  is  that  a*  exists. 

Some  generalizations  are  possible,  for  example:  let  M  be  a 
Leontief  matrix  with  substitutions  and  let  ^  -Tx  >  0  for  all  ^  in 
s  and  all  x  in  K,  one  then  shows  that  such  a  problem  can  be  reduced 
to  the  case  where  M  is  square  and  non-singular  [3]  •  In  this  case,  the 
condition  -  Tx  >  0,  for  all  ^  in  H,  and  all  x  in  K  is  not 
restrictive,  since  -T^x  <  0,  for  some  i,  is  me  nlngless  if  the 
second  stage  problem  (2)  is  a  Leontief  system  with  substitution. 

3.  The  problem  is  complete.  M  = 

By  Proposition  (11) ,  the  equivalent  convex  program  has  the  form: 
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(34)  Minimize  z(x)  =  cx  +  Q(x) 

subject  to  Ax  =  b 

X  >  0 

This  problem  was  studied  in  detail  in  f 5  ]  .  For  completeness,  we 
list  the  particular  forms  of  this  convex  program  for  some  specific 
distribution  functions,  F( 0 • 

Assumptions  on  (^,iy.F)  Equivalent  Convex  Program 

£  is  finite  {K  discrete) . Linear  program  with 

upper  boxinds 

F(0  uniform . Quadratic  Program 

F(0  continuous 

If  one  approximates  ^  by  a 
sum  of  uniformly  distributed 

random  variables,  then . Quadratic  Program 

F( C)  exponential 

If  one  approximates  the 

objective  function,  then . Quadratic  Program 

In  general . Separable  Convex  Program 

Moreover,  many  generalizations  of  the  complete  problem  lead  to  an 
identical  class  of  equivalent  convex  programs.  Let  us,  for  instance, 
consider  the  following  problem: 

Minimize  z(x)  =  ox  +  E^lq  y  +  q  y  ] 
subject  to  Ax  =  b 

Tx  +  ly"*^  -  ly  =  K,  K  on 

X  >  0,  y'^^cH,  y~  >  0 
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where 

H  =  {y^ly"^  =  -z,  z  2  0} 

If  L  is  a  Leontief  matrix  with  substitution  such  that  H 
some  >  0,  and  if  +  q  >0,  then  one  can  show  [  3] 
a  pr  blem  has  als  j  an  equivalent  convex  program  of  the  form 


contains 
that  such 

(34). 
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Appendix  I 

A  linear  program  can  be  considered  as  a  function  of  its 
parameters 

f(c,A,b)  =  {Min  cx|Ax  =  b,  x  >  O}. 

We  study  the  properties  of  this  function  where  b  is  variable.  Let 

f(t)  =  {Min  cx|4x  =  t,  x  >  O) 

C  =  {t|t  =  Ax,  X  >  0} 

(1)  Lemma:  C  is  a  convex  polyhedral  cone  containing  the  origin,  0. 

For  the  sake  of  simplicity,  we  shall  assume  that  the  matrix  A  has 
full  row  rank,  so  in  particxilar  m  ^  n.  The  case  f(t)  =  -*  for  all 

t  in  C  is  without  Interest,  and  since 

(2)  Lemma;  f(t)  =  -®  for  some  teC  iff  VttC,  fvt)  a  , 

we  shall  assume  in  what  follows  that  f(t)  >  -®  for  all  tcC .  Note 
that  f(t)  is  defined  only  for  t  in  C. 

(3)  Proposition;  f(t)  is  convex  on  C. 

Consider  any  tQ,t^eC  and  Xe[0,l].  Let  t^  =  +  (l-\)t^, 

by  (1)  we  have,  Let  x^^  be  such  that 

f(t^)  =  cXj^  =  {Min  cx|Ax  =  t^^,  x  >  O)  for  i  =  0,X,l 

then  X  =  XXq  +  (1  -X)xj^  is  a  feasible  but  not  necessarily  optimal 
solution  to;  Min  cx  such  that  Ax  =  t,^,  x  ^  0.  Consequently,  we  have 
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tiiat  f(t)  satisfies  the  Jensen's  inequality, 

Xf(t^)  +  (1  =  XCX^  +  (1  -X)CX^  =  CX  >  CXy  =  f(t^) 

for  all  in  C  and  0  ^  X  <1.  Loosely  speaking,  we  can 

rephrase  (3)  as  follows:  A  linear  program  is  a  convex  function  of 
its  right-hand  side. 

(4)  Corollary:  Let  f*(t)  =  {Min  tx|Ax  =  b,  x  ^  Oj  and  let 
C*  -  {tlf*(t)  >-*}.  Then  f*(-t)  is  concave  on  C*. 

(5)  Proposition:  If  A  is  square  and  non-singular,  then  C  is  a 
simplicial  cone  and  f(t)  is  linfar  on  C. 

It  suffices  to  remark  that  f(t)  =  cA"^t  on  C  =  {tjA'^t  ^  O}. 

(6)  Proposition:  Let  B  be  a  submatrix  of  A  such  that  B  is  an 
optimal  basis  for  some  t.  Then  3  is  an  optimal  basis  for  all  t 
in  Cg  =  {t|B"^t  >  j},  g  is  a  simplicial  cone,  and  c  C . 

(7)  Corollary:  If  B  is  an  optimal  basis  for  some  t,  then  is 

the  unique  subset  of  C  for  which  B  constitutes  an  optiiaal  basis. 

By  Propositions  (5)  and  (6): 

( B)  Corollary:  f(t)  is  linear  on  C^. 

( ?)  Proposition:  There  exists  a  decomposition  of  C  into  simplicial 

c  ynes  Ct,...,C,  such  that 
1'  ’  k 
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(i)  ^0)  i  =  where  is  a  square, 

non-singular  matrix  of  A  of  rank  m, 

(ii)  is  an  optimal  basis  for  some  t, 

(111)  ti  c ,  =  c, 
i=l  i 

( iv)  int  C.  n  int  C.  =  ^  for  i  / 

This  proposition  can  be  proved  using  (5),  (6)  and  (7).  It  is 
( h.sy  to  see  that  this  decomposition  may  not  be  unique.  By  Propositions 
(3)  and  (?)  we  get: 

(10)  Propositi  on:  f(t)  is  piece -wise  linear  on  C. 

(11)  Proposition:  f(t)  is  continuous  on  C, 

Since  f(t)  is  convex  it  is  continuous  on  the  intC,  Moreover, 
(3),  (9)  and  (lO)  imply  that  f(t)  is  linear  on,  and  in  the  neighbor¬ 
hood  of,  the  boundary. 

(12)  Corollary:  f(t)  is  uniformly  continuous  on  C. 

This  is  immediate  by  (10)  and  (11)  . 

C  nsider  the  following  problem: 

(13)  Maximize  nt  subject  to  nA  £  c 

and  let  n(t)  be  an  optimal  solution  to  (13)  for  a  given  t  in  C  . 

(14)  Proposition:  If  A  is  square  and  non-singular,  then  n(t)  is 

constant  on  C. 

It  suffices  to  r-mark  that  n(t)  =  cA  ^  on  C  =  (t|A  ^t  >  O). 
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(15)  Prop:)  si  tl  jnt  TT(t)  is  a  piece -wise  constant  function  on 

This  profiositlon  can  be  proved  using  (9)  and  (14).  Let  us 
remark  that  TT(t)  may  be  multi -valued  on  the  boundaries  of  the 
simplicial  cones  determining  the  decomposition  of  C  ,  but  it  is  single 
value!  on  their  interior. 

(16)  Proposition:  n(t)*t  is  a  supporting  hyperple.ne  to  f^t)  at 

t  —  t  j  t  c  ^  • 

Since  at  t  =  t,  the  hyperplane  n(t) ‘t  intersects  f(t)  ,  it 
suffices  to  show  that, 

TT(t)  ‘t  £  f(t)  VtcC. 

Bi.t  this  is  trup,  since  by  the  definition  of  n(t), 

n(  t)  •  t  £  n(  t)  ‘t  =  f( t) . 

This  last  proposition,  (13)  and  (11)  imply  that 

(17)  Proposition;  The  graph  of  f(t),  {(z,t)  |z  >  f(t),  teC),  is 

a  Convex  polyhe  Iral  cone  with  vertex  3. 
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Appendix  II 

The  purpose  of  this  appendix  is  to  review  some  pertinent 
properties  of  convex  functions,  define  a  "gradient"  at  all  points 
of  thf  domain  of  a  convex  function,  and  establish  a  duality  theorem 
for  the  following  problem; 

(1)  Minimize  f(x) ,  subject  to:  Ax  =  b,  x  ^  0 

In  what  follows,  we  assume  that  all  sets  considered  are  of  full 
diraensionj  if  this  was  not,  one  would  need  to  appeal  to  the  relative 
topology.  Since  the  proofs  of  the  following  propositions  are 
standard,  we  have  either  limited  ourselves  to  an  outline,  or  left  the 
proof  altogether  to  the  reader. 

A.  Convex  Sets 

A  set  C  is  convex  iff  x^,X2eC  implies  [3^,X2]  C.  Let 
9i^  =  X  and  let  X*  denote  the  conjugate  space  of  X  (the  set  of 
all  continuous  linear  functionals  on  X).  An  element  of  X*  is 
denoted  by  x*  and  the  origin  by  0*.  A  hyperplane  x*(x)=a  isa 
bounding  hyperplane  of  C  if  VxcC  we  have  x*(x)  >a  and  x*^0*. 

A  bounding  hyperplane  xj(x)=cr  isa  supporting  hyperplane  of  C  at 
Xj^  if  xj(x^)  =  Of.  Obviously,  x^  belongs  to  the  boundary  of  C 
and  for  all  x  in  the  interior  of  C,  x*(x)  >  a. 

(2)  Lemma;  C  is  convex  iff  Vx  e  boundary  of  C,  3  a  supporting 


hyperplane  of  C 


at  X. 
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3.  Convex  Functions 

Let  K  c:  K  c  where  K  is  open  and  K  is  closed  and 

convex,  and  let  f(x)  be  a  real -valued  function,  with  domain  K. 

A  function  f(x)  is  convex  on  K  if  x^,X2eK  implies 
\f(x^)  +  (1-X)f(x2)  >  f(>.x^  +  (1  ->.)X2)  »  for  all  \  in  fO,!]. 

(3)  Lemma;  If  f(x)  is  convex  on  K,  then  f(x)  is  continuous 
on  K(3  K) . 

(4)  Lemma;  f(x)  is  convex  on  K  iff  {(z,x)  |f(x)  <  z,  xcK]  is 
a  closed,  convex  subset  of 

C.  "Gradients" 

(5)  Definition;  s-(x)  =  ax  +  s-(0)  is  a  linear  supporting  fimction 

of  f(x)  at  X  in  K  if  s-(x)  =  f(x)  and  s-(x)  <  f(x)  for  all 

— 1  /  -  X  X 

X  in  K . 

Since  all  supporting  functions  to  be  considered  here  are  linear 
supporting  fimctions,  we  shall  omit  the  term  linear.  Let 
S-  =  {s-(x)}  be  the  class  of  all  supporting  functions  of  f(x)  at 
X  in  K. 

(6)  Lemma;  If  f(x)  is  convex,  then  S-  /  for  all  x  in  K. 

(4)  and  (2)  imply  that  there  exists  a  supporting  hyperplane  to 

the  set  {(z,x)  |f(x)  <  z,  xcK}  at  the  point  (f(x),x),  say  x»(x)  =  a. 
By  continuity  of  f(x)  on  K  K  and  since  f(K)  c  9?,  there  exists 
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a  supporting  hyperplane  at  (f(x),x)  such  that  the  first  component 
of  X*  =  (x*,x?  v)  is  different  from  zero.  Thus, 


s-(x) 
x'  ' 


is  a  supporting  function  of  f(x)  at  x. 


(7)  Definition;  A  vector  f-  is  a  gradient  of  f(x)  at  x  in  K, 
if  for  some  scalar  s-(0),  s-(x)  =  +  s-(0)  is  a  supporting 

function  of  f(x)  at  x. 


hy  the  definition  of  supporting  function,  it  is  easy  to  see  that 
s-(0)  =  f(x)  -  f-  •  X  .  Let  F-  =  {f-]  be  the  class  of  all  gradients 
of  f(x)  at  X  .  Note  that  there  is  a  one-to-one  correspondence  between 
F-  and  S-.  Also,  F-  and  S-  are  closed. 

X  X  '  X  X 


(8)  Proposition;  f(x)  is  convex  iff  VxL,x,eK  and  Vf  in  F 

1  ^  *1  *1 

we  have  fCx^)  -  f(x^)  >  f^Cx^-x^). 

A  judicious  use  of  the  definition  of  gradient  of  (2)  and  (4) 
proves  this  proposition. 


(9)  Corollary;  If  f(x)  is  convex  and 
K,  where  f  is  a  gradient  of  f(x) 
minimum  at  x  =  x^^. 


f  (x-x.)  ^  0,  for  edl  x  in 
at  Xj^,  then  f(x)  attains  its 


(lO)  Corollary;  If  f(x°)  <  f(x) ,  for  all  x  in  K,  then 

f  •X°  <  f  ‘X. 

.X  -  X 


36 


(11)  Proposition;  A  convex  function  f(x)  is  differentiable  at 

X  in  K  iff  f-  is  unique,  i.e.  the  cardinality  of  S-  =  card  F-  =  1. 

Then  f-  »  f,  ^  f, . .  fj  I  =  5  . 

(12)  Proposition;  Let  f(x)  be  convex  and  x°€ K ,  then 

f(x°)  =  {Min  f(x)  |xeK}  iff  s  ^(x)  =  f(x°)  is  a  supporting  function 

X 

of  f(x)  at  x°. 

Let  us  now  consider  ^*^2  ^t  ”  ^*1  and 

define  cp(t)  =  f(tx^  +  (l-t)x2)  where  t  belongs  to  T  =  5R  (1  {t|x^eK}. 

Since  K  is  open,  so  is  T.  We  denote  a  gradient  of  ;p(t)  at  €,  by 

cp^,  and  the  class  of  all  gradients  of  cp(t)  at  t,  by  =  {^^J* 
Since  f(x)  is  continuous  on  K,  so  is  cp(t)  on  T.  If  f(x)  is 
convex,  so  is  cp(t)  . 


(13)  Proposition;  If  f(x)  is  convex,  then  9  e  if  9=  f^^(x^-X2) 
for  some  f  e  F  .  \ 

(Hint;  Use  the  monotonicity  of  tW^radient  of  a  convex  function,  see  [2].) 


Let  £=  (x|x  =  tx^  +  (l-t)x2,  t  e  T,  Xj^,X2eK)  and  x°e  K  (1  In 
what  follows  we  also  assume  that  f(x)  is  convex  on  K.  The  two 
following  propositions  are  obtained  by  applying  (13)  and  observing  the 
properties  of  9(1)  on  T. 


(14)  Proposition;  If  x°e  K  and  f(x°)  <  f(x)  for  all  x  in  K, 

then  there  exists  a  gradient  f  such  that  f  •  x^  =  f  •  x  for  all  x 

*0  0  ^  ^0 


in  £. 
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(15)  Proposition; 
tnen  3x°t(x^,Xj,) 


Let  >  \’‘z’ 

such  that  f(x*^  <  f(x^) . 


(16)  Proposition;  f(x_)  <  f(x)  for  all  x  in  K  iff  3f  cF 

such  that  f  x^  <  f  •  x  for  all  x  in  K. 

*0  *0 


If  f  x^  <  f  -x  for  all  X  in  K,  then  by  (9)  is  optimal. 

^0  0  ^ 

Also,  if  X  is  not  a  minimum,  then  one  can  prove  that  there  exists 

such  that  f^x  <  f^x  for  some  xeK.  Then,  (15)  yields  the  proof  in 

the  other  direction. 


(17)  Corollary;  If  f(x)  is  convex  and  differentiable, 


is  a  minimum  of  f(x)  on  K  iff  f  ‘x  <  f  x  for  all 

a  '  ■  ""O  ^  *0 

where  f  =  *  °  ^ 

^0 


then  Xq 
X  in  K, 


D.  Special  Case;  K  is  a  compact,  convex  polyhedron 
Let  us  now  consider  problem  (l) ,  viz; 

(1)  Minimize  f(x)  subject  to  x«K  =  {x|Ax  =  b,  x  ^  03> 

where  f(x)  is  a  continuous,  convex,  real -valued  function  on  91*^  . 
Under  these  conditions,  we  show  that  the  dual  to  (1)  reads; 

(18)  Maximize  f(x)  -  f^x  +  nb 

subject  to  -  f^  +  nA  <  0 
X  >  0 
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where  Define  =  {(ti,x)  |nA  ^  for  some  x  ^  Oj* 

Obviously,  if  xeK,  then  xcK^^. 

(19)  Weak  Duality.  For  all  x  in  K  and  (n,x)  in  K^,  we 

have  f  X  >  Tib. 

X  — 

To  see  this  multiply  the  equality  constraints  of  (1)  by  n  and  the 
inequalities  of  problem  (18)  by  x  >  0. 

(20)  Strong  Duality.  There  exists  x° eK  and  (TT°,x°)eK^  such 

that  f  ^x°  =  n°b,  for  some  f  eF  . 
o’  0  0 

X  XX 

Let  f(x°)  =  Min  f(x)  for  x  in  K.  By  (l6) ,  3f  such  that 

^0 

f  x°  =  Minimum  f  x 
x°  xcK  x° 


The  dual  of  the  linear  program 

Minimize  f  ^x  subject  to  Ax  =  b,  x  >  0 

X 


is 


Maximize  nb  subject  to  ttA  ^  f 

X 

Let  TT°  be  the  optimal  solution  of  the  maximization  problem,  then 

TT°b  =  f  qX°.  Moreover,  it  suffices  to  remark  that  (n°,x°)€Kj^  to 
X 

complete  the  proof. 


If  K  is  not  compact,  f(x)  may  fall  to  attain  its  minimum 
on  K.  In  that  case,  one  replaces  Min  by  Inf  and  adjusts  the 
resulting  proofs.  This  infimum  may  be  finite  or  infinite.  The 
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solvability  of  problem  (1)  is  answered  by  Proposition  (16) . 

If  f(x)  is  differentiable,  these  duality  statements  become 
special  cases  of  the  results  of  G.  B.  Dantzig,  E.  Eisenberg,  and 
R.  Cottle  [1],  extended  later  by  A.  Whlnston. 
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